Empirical software metrics for benchmarking of verification tools
نویسندگان
چکیده
Program Variables. Bit-precision or mathematical integers? ints used as indices, bit-masks or in arithmetic? Dynamic data structures? Arrays? Program Loops. Reducible loops or goto programs? FOR-loops or advanced ranking functions? Widening, loop acceleration, termination analysis, or loop unrolling? Control Flow. Recursion? Function pointers? Multithreading? Straight-line code or complex branching?
منابع مشابه
Towards Practical Predicate Analysis
Software model checking is a successful technique for automated program verification. Several of the most widely used approaches for software model checking are based on solving first-order-logic formulas over predicates using SMT solvers, e.g., predicate abstraction, bounded model checking, k-induction, and lazy abstraction with interpolants. We define a configurable framework for predicate-ba...
متن کاملBenchmarking and Resource Measurement
Proper benchmarking and resource measurement is an important topic, because benchmarking is a widely-used method for the comparative evaluation of tools and algorithms in many research areas. It is essential for researchers, tool developers, and users, as well as for competitions. We formulate a set of requirements that are indispensable for reproducible benchmarking and reliable resource measu...
متن کاملOpen Source Reference Systems for Biometric Verification of Identity
This paper focuses on the common evaluation framework which was developed by the BioSecure Network of Excellence during the European FP6 project BioSecure (Biometrics for Secure authentication). This framework, which is composed of open-source reference systems, publicly available databases, assessment protocols and benchmarking results, introduces a new experimental methodology for conducting,...
متن کاملEmpirical Evaluation and Review of a Metrics-Based Approach for Use Case Verification
In this article, an empirical evaluation and review of some metrics–based verification heuristics for use cases are presented. This evaluation is based on empirical data collected from requirements documents developed by Software Engineering students at the University of Seville using REM, a free XML–based requirements management tool developed by one of the authors. The analysis of the empiric...
متن کاملSoftware Inspection Benchmarking - A Qualitative and Quantitative Comparative Opportunity
Software inspections are commonly used throughout the software industry, but there are still open questions about the relationship between inspection processes and inspection effectiveness. For example, which techniques work best in various environments? Are requirements specifications inspections and code inspections different in terms of effectiveness? What is the effectiveness in inspections...
متن کامل